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Abstract. We study the existence and orbital stability /instability of periodic 
standing wave solutions for the Klcin-Gordon-Schrodinger system with Yukawa 
and cubic interactions. We prove the existence of periodic waves depending 
on the Jacobian elliptic functions. For one hand, the approach used to obtain 
the stability results is the classical Grillakis, Shatah and Strauss theory in the 
periodic context. On the other hand, to show the instability results we employ 
a general criterium introduced by Grillakis, which get orbital instability from 
linear instability. 

1. Introduction. 

In this paper wc shall investigate the orbital stability of periodic standing wave 
solutions associated to the Klcin-Gordon-Schrodinger system (KG-NLS henceforth) , 



(1) 



1 . df 

iu t + -Au = -w^p(|u| ,v) 



v tt - Av + m 2 v = /(|u| 2 ,i;) + v— (|u| 2 , v), 

ov 



when /(s, t) = s and f(s, t) = st, here s,t£l. 

If f(s, t) = s equations in (1) are the so-called Klcin-Gordon-Schrodinger system 
with Yukawa interaction and it describes a system of conserved scalar nucleons 
interacting with neutral scalar meson. Here u : R d x R — ► C represents a complex 
scalar nucleon field and v : M. d x R — > R a real scalar meson field. The real constant 
m 2 determines the mass of a meson. The full system (1) was motivated by Hayashi's 
paper [22]. 

We restrict ourselves to the case d = 1. The periodic standing waves we are 
interested in arc of the form 

(2) u(x, t) = e lct ip c (x), v(x, t) = <f> (x), 
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where c £ R and ip c , <f> c : R — ► R are smooth periodic functions with a fixed period 
L > 0. 

Studies related to the stability of stationary waves and well-posedness results for 
equations (1), have been having a considerable development in recent years. For 
instance, when d = 3, Ohta in [28], obtained a result of stability for stationary 
states for equations (1) (f(s,t) = s) by using the variational approach introduced 
by Cazenave and Lions in [12]. Later, Kikuchi and Ohta in [25], established a result 
of orbital instability related to the same equation when the wave-speed c > is 
sufficiently small. On the other hand, Baillon and Chadam in [9] deduced existence 
of global solutions by using the LP — L q estimates for the elementary solutions of the 
Schrodinger equation. Fukuda and Tsutsumi in [15], discussed the initial boundary 
value problem of KG-NLS (1) and obtained the global existence of strong solutions 
in the three-dimensional case, and later the results were improved in [21]. Others 
contributors can be mentioned as [8], [13], [14], [22], [30], [36]. 

In the one-dimensional case, Tang and Ding in [34] (see also [35] ) studied a result 
of modulational instability related to the general Klcin-Gordon-Schrodingcr given 

by 

!iu t + au. xx + puv + 7i|u| 2 u = 
vtt - c\v xx + m 2 v + 72U 3 - fi\u\ 2 = 0, 

where u, v and m 2 are given as above, ji, i = 1,2 are cubic nonlinear auto- 
interactions, (3 and p are quadratic coupling constants and, a and Cq are constants. 
Further, it was found that there are a number of possibilities for the modulational 
instability regions due to the generalized dispersion relation, which relates the fre- 
quency and wave-number of the modulating perturbations. When 71 = 72 = 0, 
a = h and f3 = p = Cg = 1, equation (3) becomes (1) with f(s,t) = s. 

In general, the studies about the stability/instability to Klein-Gordon (KG hence- 
forth) and nonlinear Schrodinger (NLS henceforth) equations have attracted a large 
set of researchers. It is known that both KG and NLS equations, specially with cubic 
interactions, have wide applications in many physical fields such as nonlinear optics, 
nonlinear plasmas, condensed matter and so on. Besides, a similar system given by 
equations in (3) may describe the dynamics of coupled electrostatic upper-hybrid 
and ion-cyclotron waves in a uniform magnetoplasma (see [34] and [37]). 

In a stability/instability approach if one considers the general KG equation 

(4) u tt - Au + f(\u\ 2 )u = 0, teR, xeM. d , 

Grillakis [19] (see also [17], [20]) determined sufficient conditions for the orbital 
instability of the standing waves e lct tp(x) in the space of radial functions, where 
tp(x) = <p{\x\) has a finite number of nodes (with some restrictions on the nonlin- 
earity). Others contributions in this qualitative approach can be mentioned, for 
example, [31], [32] and [33]. In the periodic context, a recent work due to Natali 
and Pastor in [27] determined stable/unstable families of periodic standing wave 
solutions for equation (4) when f(v) = 1 — v and f(v) = v (with d = 1) making use 
of the abstract theory established in [17] and [18]. 
Next, when the NLS 

(5) iu t + Au+\u\ p ~ 1 u = 0, teR, xeR d , 

is considered, a large amount of papers concerning the stability/instability of stand- 
ing waves can be found in the current literature. In particular, Cazenave and Lions 
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in [12], determined the existence of stable ones, of the form u(x,t) = e luJt ip(x), for 
equation (5) with d > 1 and 1 < p < 1 + 4/d. In [17] and [18] is possible to find a 
set of sufficient conditions that determines stability/instability of standing waves for 
that equation. In this case, the theory of stablity/instability related to the periodic 
case (for d = 1) have been a terrific development, for instance [1], [5], [6], [7], [16] 
and [29] . 

The methods used in the present paper in order to show our stability/instability 
results will be the ones developed by Grillakis et al. [17], [18] and Grillakis [19], [20]. 
The main reason for this is because system (1), when f(s, t) = s or f(s, t) = st, can 
be seen as an abstract Hamiltonian system 



(6) 



dU(t) 
dt 



= J£'(U(t)), 



where U = (ui, V\, U2, U2) = (Rezt, v, Imu, vt), £ represents the energy functional 
and J is the skew-symmetric matrix defined by 



/ 



(7) 



V 
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o\ 
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) 



Firstly, we consider the case f(s,t) = s. In order to get explicit solutions we 
suppose -0c = V%4>c m (2). Thus, substituting (2) into (1) (with ip c = y/2(j> c ), it 
follows that (j) c must satisfy the ordinary differential equation 



(8) 



- ft + 2c(b c - 24> 2 C = 0, 



where 2c = to 2 . Multiplying equation (8) by 4>' and integrating once, we obtain 



(9) 



65, 



where ip u = 4(/> c , B Vu) is a nonzero integration constant and tu := lu(c) = 2c. A 
positive solution obtained from (9) depending on the cnoidal Jacobi elliptic function 
(see Byrd and Friedman [11]) is given by 



(10) 



<p u (x) = A + (As - ftOcn 2 



12 



where Pi, i = 1,2,3 and the modulus k depend smoothly on u> (and therefore on c). 

As it is well-known, the main ingredient on the theory developed in [17]-[20] is the 
spectral properties of the linear operator arising in the linearized equation around 
the traveling wave. Here, by making use of the Floquet theory we can determine 
that matrix operators 



(11) 



Id 2 \ 
-— + 2c-2<p -2V2(f> \ 



2c 
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and 



(12) 



dx 2 



2c - 20 







1 



have the spectral properties required in [18] and [20]. This allow us to prove our 
stability/instability results concerning the cnoidal solution in (10). 

Secondly, we consider the case f(s, t) = st. In this case, if we substitute (2) into 
(1) with ip c = <j) c , we obtain the differential equation (after integrating once) 



2B, 



(13) W L Y = ~€ + 2c0; 
Thus, a dnoidal wave solution can be found: 

(14) Mt)=Vdn(v£;k), 

where r\ > depends smoothly of the wave-speed c > 0. 
The linear operators arising in this case are: 

d 2 



( 



(15) 



and 



(16) 



£ll,dn — 



■— r+2c-2<^ 
dx* 



dx 2 



2c 



20 2 j 



C 



X ,dn 



( 
\ 



d? 

dx 2 



— + 2c - 2</. 2 
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which also possess the spectral properties needed in [18] and [20] that guarantees 
our stability/instability results. 

We point out that our orbital stability results will be with respect to periodic 
perturbations having the same fundamental period as the corresponding traveling 
wave, whereas the instability results will be with respect to periodic perturbations 
having twice the fundamental period as the corresponding traveling wave. 

The question about global wcll-posedness in the energy space Hp er ([0, L}) x 
Hp er ([0, L}) x L 2 er ([0, L}), associated to system (1) can be established by a direct 
application of Kato's classical theory (see [30]). Many other results of local and 
global wcll-posedness for these two equations can be found in the current literature, 
as for example [8], [10], [13], [36]. 

In order to show the current findings, the paper is organized as follows. In Section 
2 we present an explicit family of periodic solutions related to equation (1) when 
f(s,t) = s and study their orbital stability /instability. In Section 3 we consider 
the case f(s,t) = st and establish the existence and stability/instability of another 
family of periodic solutions. 

Notation. For s <G K, the Sobolev space Hp er ([0, L]) is the set of all periodic 
distributions such that 



+oo 



2 

H'[0,L] 



\ = L J2 (l + \k\ 2 ) s \f(k)\ 2 <oo, 



k— — oo 
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where / is the Fourier transform of /. The symbols sn(-;k), dn(-;k) and cn(-;fc) 
will denote the Jacobian elliptic functions of snoidal, dnoidal and cnoidal type, re- 
spectively. Quantities Re(z) and Im(z) denote, respectively, the real and imaginary 
parts of the complex number z. 

Note that system (1) can be written in three distinct form: besides (1), we can 
write it as a first-order system (in t) and, finally, separate the real and imaginary 
parts of u. We use any one of these forms without further comments. 



2. Orbital stability of cnoidal wave solutions for system (1) 



This section is concerned with the existence and orbital stability/instability of 
periodic solutions to the KG-NLS system 



(17) 

of the form 
(18) 

where <f> c : R — > R is a smooth positive periodic function with a fixed period L > 0, 
t GM. and c > 0. In fact, for 2c = to 2 , equation (17) becomes 



. vu ~ v X x + m 2 v = \u\ 2 



{u{x,t),v{x,t)) = (e w ^ t (i),^(i)) 



(19) 



2c<p c - 2(f> 2 c = 0. 



2.1. Existence of standing waves. Here our goal consists in showing that equa- 
tion (19) has a smooth branch, c € / i— * <f> c , of positive periodic solutions with a 
fixed period L > for some parameter interval /. First we define 

(20) y c := 4<£ c . 

Letting 2c = oj, we obtain from (19) and (20) that 

1 

2 



(21) 



- ^ + cj^ - ±-(fl = 0. 



The next step is to deduce a L— periodic solution tp = (p u for (21). Indeed, 
multiplying equation (21) by tp' and integrating once, we get 



(22) 



6S„ 



';((p-0i)((p-02)(Ps-(p), 



where B v is a nonzero integration constant and (3\ , /?2 , /?3 are the zeros of the poly- 
nomial F(t) = — t 3 + 3ujt 2 + 6B V . We can suppose, without loss of generality, that 
03 > P2 > 01 and 03 > 0. Therefore, we should have the relations 



(23) 



f 01 +02 + 03 = 3W, 

0201 + 0301 + 0302 = 0, 
{ 010203 - 6B V , 



(i 
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A periodic solution for the differential equation (21) is obtained from the standard 
direct integration method (Byrd and Friedman [11], see also [2]-[5]), namely, 

(24) Vu {x) = p 2 + (/3 3 - /3 2 )cn 2 S I; k) , fc 2 



p3 - Pi ' 

Moreover, we conclude from identities (23) and (24) that the roots Pi,P 2 ,P 3 must 
satisfy pi < < 02 < @3 < 3w and function in (24) has fundamental period given 

by 

(25) T v = lAi K(k v ), 

VPs — Pi 

where k = k v is the so-called elliptic modulus and K represents the complete elliptic 
integral of the first kind defined by 



K(k) = [ 
Jo 



dt 



v /(l-t 2 )(l-fc 2 t 2 ) 
From relations in (23) we obtain, after some calculations, that 

(26) Pi + (P 3 - 3u)p 2 + (Pi - 3cop 3 ) = 0, 
whose value of P2 is given by 

(27) p 2 = X - -p 3 + yW + 6^/3 3 - 3/3f^ . 

Therefore, from (23) and (27), we deduce 

1 
2 

and 



(28) p 3 - pt = £ [ 3P 3 - 3cj + + &up 3 - 3pj 



1 



(29) Ps-fc = - 2 [3p 3 - 3w - ^ 9cc 2 + 6ujp 3 - 3/3 3 2 

Identities (28) and (29) able us to conclude that the modulus k must satisfy 



fc2 = 3p 3 -3w- yg + 6u;p 3 - 3Pl 
3P 3 -3uj+ ^/9uj 2 + 6ujP 3 - 3P'i ' 

Moreover, thanks to (29) we obtain the inequality < Pi < 2lu < P 3 < 3lu. 

Let u > be fixed, from (30), asymptotic properties of K and the fact that 
P 3 £ (2ui, 3lu) — > Ttp(P3) is a strictly increasing function (see Theorem 2.1 below) it 
follows that T v > 27r/v / w- This means that for any L > fixed, choosing u) > 
such that co > Air 2 /L 2 there is a unique p 3 = P 3 {lo) £ (2w,3w) such that the 
corresponding cnoidal wave give by (24) has fundamental period T v = L. 

Remark 1. The solitary wave solution for equation (21) can be determined from 
the asymptotic properties of Jacobi elliptic function an given in (24). In fact, for 
u) > fixed, if Pi,P 2 — > (then p 3 — > 3uj), we get, k — > 1 _ . On the other hand, 
since cn(-, 1~~ ) ~ sech(-), we obtain the single-humped function 



<£u{x) — 3lu sech x 
which is the solitary wave solution for equation (21). 
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Next, we shall construct a smooth curve, u> t— ► tp u , of cnoidal wave solutions for 
equation (21). 

Theorem 2.1. Let L > be arbitrary but fixed. Consider u>q > 47T 2 / L 2 and the 
unique (3$$ = Pai^o) £ (2luq,3ujo) such that T Vu — L, then 

(1) there exists an interval I(u>q) around loq, an interval B([3 3 _q) around (3 3 fi 
and a unique smooth function T : I(loq) — ► B(f3 3 ^o) such that T(luq) = /3 3t o 
and 

^ K(k) = L, 

^3f3 3 -3uj + V9^ 2 + 6w/3 3 - 30$ 

here to £ I(u>o), 03 = r(w) G B(f3 3 0) and k 2 = k 2 (to) £ (0, 1) is given by 
(30). 

(2) The cnoidal wave solution in (24), V'wC'i Pii @2, P3), determined by /3j = 
(3i(uj), i = 1,2,3, has fundamental period L and satisfies (21). Moreover, 
the mapping 

u £ /(w ) ^ (p u G H£ er ([0, L}), n = 0, 1, . . . 

is a smooth function. 

(3) L(loq) can be chosen as (47r 2 /L 2 , +00) . 

Proof. The proof is an application of the Implicit Function Theorem and it follows 
closely the arguments in Angulo and Linares [5, Theorem 3.1] (see also [3] and [4]). 
Thus, we omit it here. □ 

Remark 2. From the Implicit Function Theorem, Theorem 2.1 and (25) we can 
conclude that function T : I(ujq) — > B((3 3 ^) given in Theorem 2.1 is a strictly 
increasing function. Moreover, dk/duj > (this fact can also be found in [1] or [7]). 

Remark 3. From Theorem 2.1 and identity (26) we are in a position to conclude 
that uj = (l6K 2 y/l-k 2 + k 4 )/L 2 , f3 3 = 16K 2 |Vl - fc 2 + fc 4 + 1 + k 2 ] /L 2 , f3 3 - 
[S-i = 48K 2 /L 2 and (3 3 - = 48k 2 K 2 /L 2 . 

As a consequence of Theorem 2.1, we immediately have: 

Corollary 1. Let c £ (2ir 2 /L 2 , +00) and to(c) = 2c. Then the cnoidal wave 4> c = 
</? a) ( c )/4, where <p w ( c ) is give in Theorem 2.1, has fundamental period L and satisfies 
(19). Moreover, the mapping 

c £ +ooj <—>■ 4> c £ H; er ([0, L}), n = 0, 1, . . . 

is a smooth function. In addition, dk/dc > 0. 

2.2. Spectral analysis. We start establishing the basic framework for the stability 
study introduced in [18] and [20]. As we have already mentioned, we can write 
system (17) as a Hamiltonian system 

(31) ^ = J£'(U(t)), 

where U = (ui, V\,U2, V2) — (Re(it), v, Im(u), Vt), J is the matrix defined in (7) and 
£ is the energy functional 

(32) £(U) = l -l [u\ x + u\ x + v 2 + vl x + m 2 v 2 - 2 Vl (u 2 + u 2 )] dx. 



8 



FABIO NATALI AND ADEMIR PASTOR 



We remind the reader that system (17) also preserves the L 2 -norm of u, that is, 
the quantity 



(33) 



F{U) = [ (uj+ u\)da 
Jo 



is a conserved quantity of system (17). 

In what follow in this section we will denote <f> = (V2~4>, 4>, 0, 0), where (f> — (j> c is 
the cnoidal wave given in Corollary 1. 

It is well-known that to apply the abstract Grillakis et al. theory we need to 
study the spectral properties of operator 



(34) 
where 

(35) 

and 
(36) 



£"(*)+ oF"($) 




■'TZ.cn — 



dx 2 



2c 



ly/2(j) \ 



d 2 

-2V24> ~dx 2+2c 



Cn 



dx 2 



2c -20 







1 



We begin by studying the spectra of operators C-n,cn and Cx,cn- More precisely, 
we have: 

Theorem 2.2. Let <f> = <fi c be the cnoidal wave solution given by Corollary 1. Then 

(i) operator C-ji.cn ^ n (35) defined in Lp er ([0, L}) x L 2 er ([0, L}) whose domain 
is H 2 er ([0, L}) x Hp er ([0, L]) has exactly one negative eigenvalue which is 
simple; zero is a simple eigenvalue whose eigenfunction is (20'/3, \/2(f)'/3). 
Moreover, the remainder of the spectrum is constituted by a discrete set of 
eigenvalues. 

(ii) Operator Li.cn in (36) defined in L 2 er ([0, L]) x L 2 er ([0, L]) whose domain is 
H 2 er ([0, L]) x Lp er ([0,L]) has only non-negative eigenvalues being zero the 
first one which is simple with eigenfunction (4>,0). Moreover, the remainder 
of the spectrum is constituted by a discrete set of eigenvalues. 

We point out that from Weyl's essential spectrum theorem, all operators we 
study here have only point spectrum. 

Before proving Theorem 2.2, we note that operator Cfi,cn can be diagonalized 
under a similarity transformation. In fact, we consider 
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Then operator Con '■= A-nCn^nA^ 1 , is a diagonal operator given by 
(37) C Dn = ' 







with 



(38) £i, c „ = -— + 2c-40 
and 

d 2 

(39) £ 3 ,cn = -^2 +2c + 2</>. 

The next lemma give us the spectral properties of operators £i jCn and £2,cnj 
where C\ yCn is defined in (38) and 

(40) £ 2iC „ = -^j + 2c-2</». 

Lemma 2.3. Let <p — <p c be the cnoidal wave given by Corollary 1. Then the 
following spectral properties hold: 

(i) operator C,\, cn in (38) defined in L 2 er ([0, L]) with domain H 2 er ([0, L]) has 
exactly one negative eigenvalue which is simple; zero is an eigenvalue which 
is simple with eigenfunction <p' . Moreover, the remainder of the spectrum 
is constituted by a discrete set of eigenvalues, 
(ii) Operator C2.cn in (40) defined in L 2 er ([0, L}) with domain H 2 ([0, L]) has 
no negative eigenvalues; zero is an eigenvalue, simple with eigenfunction <p. 
Moreover, the remainder of the spectrum is constituted by a discrete set of 
eigenvalues. 

Proof, (i) The main point is that the periodic eigenvalue problem associated to 
operator £i jCrl , 



(41) 



/(0) = f(L), f (0) = f'(L), 



is equivalent (under the transformation *ff(x) — f(9x),6 2 = 12/(03 ~ Pi)) to the 
periodic eigenvalue problem 

d 2 



(42) 



, + [5 - I2k 2 sn 2 (x; fell* = 
dx 2 



. *(0) = ^(2K(k)), *'(0) = y'(2K(k)), 
associated to the Lame equation with 



(43) 5=- (A + /? 3 -2c) = - -(X + fo-u). 

P3 - Pi PS- Pi 

The proof of this item follows from Floquet Theory and the basic ideas can be found 
in [5, Theorem 4.1] (see also [2]). However, for the sake of clearness we will list the 
basic facts. Indeed, since C\, cn <t>' = and <p' has two zeros in [0, L), then zero is the 
second or the third eigenvalue of £i jC n- Next, since 8\ = 4 + 4fc 2 is an eigenvalue 
to (42) with eigenfunction ^i(x) = cn(x)sn(x)dn(x), we have that Ai = is a 
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eigenvalue to (41) whose eigenfunction is 4>' . On the other hand, from Ince [23] we 
have that the Lame polynomials, 



are the eigenfunctions related to other two eigenvalue So, 82 given by, 
(45) S = 2 + 5fc 2 - 2-v/l - k 2 + 4k 2 , S 2 = 2 + 5k 2 + 2y/l - k 2 + 4k 2 . 

Since ^0 has no zeros in [0, 2K] it follows that So will be the first eigenvalue to 
(42). Since S < Si for all k G (0, 1), we obtain from (43) that A < 0. Therefore 
Ao is the first eigenvalue to C\. cn which is simple. Moreover, since Si < 82 for every 
k G (0, 1), we obtain from (43) that A2 > 0. This fact implies that A2 is the third 
eigenvalue to £i, c „ and therefore Ai = results to be simple. 

(ii) It follows immediately from the Floquet theory since C2,cn4> = and 4> has 
no zeros in the interval [0, L]. □ 

Proof of Theorem 2.2. (i) Since <p is strictly positive, it follows that operator Cs, C n 
is strictly positive and cr(£3 iC „) > 2c, where cr(£3 jCn ) denotes the spectrum of 
^3,cn- Next, let / = (g,h) 1 ^ be such that Con f = , then C\, cn g = and 
^■3,cnh = 0. Thus, from Lemma 2.3 we have h = and g = a<j)' , for some nonzero 
real constant a. Hence, the kernel of Con is generated by (^',0)'. This implies 
that the kernel of £n,cn is 1-dimensional and generated by (20'/3, y/2<f>/3). 

Next we consider A < and / = (g, h)* 7^ such that Con f — A / , then h = 
and Ci tCn g = Xg. Therefore, from Lemma 2.3 we must have A = Ao and g = ftxo, 
where Ao is the unique negative eigenvalue of L\ }Cn and Xo is the corresponding 
eigenfunction. This implies part (i) of the lemma. 

(ii) It follows immediately from Lemma 2.3 since operator £2,™ has no negative 
eigenvalues and zero is a simple eigenvalue. □ 

Theorem 2.2 give us the spectral properties needed to prove our stability results 
when we consider periodic perturbations having the same fundamental period as 
the corresponding wave itself. However, we are also interested in perturbations 
having twice the fundamental period as the corresponding wave. In this regard, the 
following lemma is useful. 

Lemma 2.4. Let <p — <p c be the cnoidal wave solution given by Corollary 1. Then, 
the linear operator L\. cn in (38) defined in L 2 er ([0,2L]) with domain H 2 er ([0, 2L]) 
has its first four eigenvalues simple, being the eigenvalue zero the fourth one with 
eigenfunction </>'. Moreover, if Xi an ^ Xi denote the eigenfunctions associated to 
the second and third eigenvalues then Xi -L (j>, i = L 2. 

Proof. The proof follows the same steps as in Lemma 2.3 and a more detailed proof 
can be found in [5, Theorem 4.2]. It is easy to see that 



are the first two eigenvalues for the semi-periodic eigenvalue problem associated 
with the Lame equation in (42). The eigenfunctions are given, respectively, by 



$o(x) = dn{x)[l - (1 + 2k 2 - Vl - k 2 +4k 4 )sn 2 (x)), 



(44) 



$ 2 (x) = dn(x)[l - (1 + 2k 2 + VI - k 2 + 4k 4 )sn 2 (x)}, 



So = 5 + 2k 2 - 2 v / 4-fc 2 + fc 4 , 81 = 5 + 5k 2 - 2\J 4 - Ik 2 + 4k A 



*o(s) 
*i(ar) = 



= cn 



(x)[l - (2 + k 2 - V4- k 2 + k 4 )sn 2 (x)} 



= sn 



(x)[3 - (2 + 2k 2 - V4-7fc 2 + 4k 4 )sn 2 {x)} 
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Hence, if po and pi are the first two eigenvalues for the semi-periodic eigenvalue 
problem associated with operator £i, c „, we obtain from (43) (with 8 and A replaced, 
respectively, with 8 and p) that (see e.g. [26, Theorem 2.1]) 

A < pa < Pi < Ai = 0, 
where Ao and Ai are given in Lemma 2.3. The orthogonality condition follows from 
the explicit forms of xi and X2- This completes the proof of the lemma. □ 

2.3. Orbital stability. First of all, let us make clear our notion of orbital stability. 
Since system (17) has phase and translation symmetries, that is, if (u(x,t),v(x,t)) 
is a solution of (17), so are 

(46) (u(x + xo, t), v(x + xq, t)) 
and 

(47) (e is u(x,t),v(x,t)) =: P s (u,v){x,t), 

for any xq, s S R, our definition of orbital stability in this subsection is as follows: 

Definition 2.5. A standing wave solutions for (17), (e lci, c (a;), <fi c {x)), is said to be 
orbitally stable in X = H^ er ([0, L]) x H^ er ([0, L]) x L 2 per ([Q, L]) if for any e > there 
exists 8 > such that if (uq,vq,vi) <g X satisfies ||(uo,vo> w i) — (^c 7 0c, 0)||x < S, 
then the solution u (t) = (u,v,vt) of (17) with u (0) = (uq,vq,vi) exists globally 
and satisfies 

sup inf \\-lt{t)-{e is T y M-),Tyct>c(-)M\x < e. 

t>0 s,y6R 

Otherwise, (e lct il} c (x), <fi c (x)) is said to be orbitally unstable in X. 

Here, T y g(x) = g(x + y). Our stability result reads as follows: 

Theorem 2.6. Let <p c be the corresponding cnoidal wave obtained in Corollary 1. 
Then the periodic wave solution (^/2e lct cf> c , <j> c ) is orbitally stable in X by the periodic 
flow of system (17). 

Proof. We apply the abstract Stability Theorem in [18]. From Theorem 2.2 we see 
that operator C cn has the spectral properties required in Grillakis et al. [18] to apply 
the abstract theorem. Indeed, Theorem 2.2 implies that operator C cn has only one 
negative eigenvalue which is simple and its kernel is 2-dimensional. Moreover, the 
remainder of the its spectrum consists on a discrete and positive set of eigenvalues. 

Also, it is easy to see that our smooth curve of periodic solutions given in Corol- 
lary 1 is a family of critical points for the functional 7i = £ + c!F, that is, 

(48) H'(V2> C ,0 C ,O,O) = O. 
Finally, we need to study the convexity of the real function 

(49) d(c) = £(V24> e , 0c 0, 0) + cF{V2dp c , cf> c , 0, 0). 

From (48) we obtain that d'(c) = !F(s/2^) c , <j) c , 0, 0). Hence, from Theorem 2.1, 

\\ 2 c {x)dx) 



(50) 




tp u (x)dx 
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In order to finish the proof, we just need to show that d"(c) > 0. To show this, 
we integrate equation (21) over [0, L] to conclude that 

<p u (x)dx = 2uj ip u (x)dx. 
Jo 

However, to verify that d"(c) > it is sufficient to prove that T(u>) = (p u (x)dx 
is a strictly increasing function. In fact, from Byrd and Friedman's book [11] we 
deduce from the fact f3 3 - (3 2 = A&k 2 K 2 / L 2 , that 

(51) T(w) = ^-lu {K{k) 2 y\-k 2 + k± + 1 - 2k 2 } + 3K(k)[E(k) - k' 2 K(k)]j . 
Since 



f(k) = K(k) 2 [Vl — k 2 + k 4 + 1 - 2k 2 } + 3K(k)[E(k) - k' 2 K{k)} 
= K{k) 2 Wl -k 2 + fc 4 + k 2 - 2} + 3K(k)E(k), 



function / : (0, 1) — > M defined in (52) is a strictly increasing function with respect 
to the modulus. Moreover, from Remark 3 we have dk/duo > 0. Thus, we conclude 
that T(w) is a strictly increasing function and therefore d"(c) > 0. □ 



Remark 4. By using the same framework as presented in this section (with the nec- 
essary modifications) , one shows the stability of the solitary standing wave solution 
2e lct 4> c {x), 4> c (x)), x G K, c > 0, for equation (1) with f(s,t) = s, where 



(V2e ict 



4> c {x) = 6c sech 2 



is the solitary wave given in Remark 1. 

2.4. Orbital instability. Let <j> = 4> c be given in Corollary 1. This section is 
devoted to prove that the corresponding standing wave is unstable in the space 
Hp er ([0, 2L}) x Hp er ([0, 2L}) x L 2 er ([0, 2L}), that is, the standing waves are unstable 
with respect to periodic perturbations having twice the fundamental period as the 
corresponding wave. The ideas to obtain such result is to get orbital instability 
from the linear instability of the zero solution for the linearization of (17) around 
the orbit generated modulus phase, {P ct (y/2(j>, cj>, 0, 0); t € K}, where P s is the 
transformation defined in (47). Note that P s (acting on real- valued functions) can 
be described as 

cos s — sin s 
10 
sins coss 
1 



(53) 



P, 



/ 




( 




Vi 










V 


V2 J 


V 



\ 


( U1 \ 










1 


\ V2 J 



The clever reader has already noted that our notion of stability here is slightly 
different from that one in Subsection 2.3. In fact, our definition is only modulo 
phase. 

Definition 2.7. Let Y = f^ er ([0,2L]) x H^ er ([0,2L]) x L% er ([0, 2L}). The orbit 
generated modulus phase, {P sc (ip c , 4>c 0);s G R}, is said to be orbitally stable in Y, 
if for every e > there exists a S > such that if z a £ Y and \\z — (tp c , 4> c , 0)\\y < ^ 
then the solution z(t) of (17) with z(0) = zq exists for all t and 

sup inf \\z(t) - P s (ip c ,^ c ,0)\\ Y < e. 
t>o s e K 
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Otherwise, the orbit is said to be orbitally unstable in Y. 

First of all we note that linearizing system (17) around the orbit 

Q = {P cs (V2<t>,(t>,Q,0), se«}, 

we get the equation 

(54) ^ = JC cn V + 0(\\V\\ 2 ), 

where V{t) = P ( _ ct) Z7(i) - (V20, <f>, 0, 0), J and £ cn are the operators defined in (7) 
and (34), respectively. 

In order to prove that (54) has the zero solution as an unstable solution we know 
that it is sufficient to prove that JC cn has finitely many eigenvalues with strictly 
positive real part. Moreover, this implies that orbit f2 is orbitally unstable (see [18], 
[19]). Actually, we prove: 

Theorem 2.8. Let cf> = <f> c be the cnoidal wave given by Corollary 1. Then the 
orbit 

= {P CS (V2(/), 0,0,0), seE.} 
is orbitally unstable in the space Y = Hp er ([0,2L]) x Hp er ([0,2L]) x Lp er ([0,2L]). 

Proof. From Lemma 5.6 and Theorem 5.8 in [18], we know that JC cn has finitely 
many eigenvalues with strictly positive real part. Hence we only have to prove that 
JCcn has at least one eigenvalue with strictly positive real part. To prove this, we 
use the approach introduced by Grillakis [20]. We start by defining 

Z = {Ker(£ n , cn ) U ifer(£ I)C n)]~S 
£n,cn = restriction of C n , cn on Z n H% er ([0, 2L]), 
£iL = restriction of ££ m on Z n H 2 per ([0, 2L]). 
With this definitions, Theorem 2.6 in [20] states that JC C n has exactly 

(55) max{n(£ w , cn ), n(£^ cn )} - d(C{C^ cn ) n C(C^ cn )) 

± pairs of real eigenvalues, where C(C) = {z E Z; (Cz^z)^^ < 0} denotes the 
negative cone of operator C and d(C(C)) denotes the dimension of a maximal linear 
subspace that is contained in C{C). 

Hence we just need to prove that the number in (55) is strictly positive. We 
first observe that since zero is the first eigenvalue of Cj yCn (see Theorem 2.2) it 
follows that such operator is a positive operator on Z and so C*(>Cj^, n ) = and 
n(Cj 1 cn ) = 0. Thus, the number in (55) reduces to n(£.Tz^ cn ). 

Let us prove that n(£n,cn) = 2. Indeed, from the definition of C-n,cn and Lemma 
2.4 we see that n{C-n,cn) < n{C-jz,cn) < 3. Now let Ao, Ai and A2 be the three nega- 
tive eigenvalues of operator C\. C n given by Lemma 2.4 with respective eigenfunctions 
Xo,Xi and y 2 . Thus, 

^o = (2y /3,V2xo/3), J?i = (2xiA V2 X i/3) and ^ 2 = (2 X2 /3, V2 X2 /3) 
are eigenfunctions of C-jz^n associated to eigenvalues Ao,Ai and A2, respectively. 
Since Ker(£x^ cn ) is generated by $ = (</>, 0) (see Theorem 2.2), we obtain from 
Lemma 2.4 that 

— > 2 
(Xj, = 3<Xj.$L5. r =0, 3 = 1,2. 
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Moreover, (xo, ^)L 2 er xL 2 er = 2/3{xo, ^L 2 ^ > since xo and 4> are strictly posi- 
tive functions. This completes the proof of the Theorem. □ 

3. Orbital stability of dnoidal wave solutions for system (1). 

The purpose of this section is to establish the stability /instability of dnoidal wave 
solutions for system (1) when f(s,t) = st, namely. 

1 



(56) 



iu t H — u xx = —v 2 u 



v t t - v xx + m 2 v = 2\u\ 2 v. 
Here we look for solutions of the form 

u(x, t) = e lct (j) c (x), v(x, t) = <j) c (x) 

where <f> c is a smooth L— periodic real- valued function and c > is the wave-speed. 
Substituting this form in (56) we see, after integration, that <j> c must satisfy 

(57) [&] a = -^ + 2c$ + 2B* , 

for some real constant B<f, a . A smooth positive periodic solution for (57) is given by 
(see e.g., [1] or [11]) 

(58) <j) c (x) = r)dn(r]x;k), fee (0,1), 
where 

(59) t? =— and c = —(2-k 2 ). 

Remark 5. The solitary standing wave solution related to equation (57) with 
B ( p a = can be obtained from equation (58), namely. 

(60) 4>c{x) = y/csech(y/cx), Igl. 

If we consider the same steps as that ones for proving Corollary 1, for each 
L > we can construct a smooth branch (depending on c) of dnoidal waves having 
fundamental period L. The next proposition summarizes these results. 

Proposition 1. Let L > fixed and c G (n 2 / L 2 , +oo). Then the dnoidal wave 4> c 
given by (58) has fundamental period L and satisfies (57). Moreover, the mapping 

c £ (ir 2 /L 2 , +c^) -> C G H; er ([0, L]) 

is a smooth function and the modulus k = k(c) satisfies dk/dc > 0. 

Remark 6. The fact that dk/dc > follows immediately from (59) and the Inverse 
Function Theorem. 

3.1. Spectral analysis. Let <j> = <f> c be the dnoidal wave given by Proposition 1. 
As in Subsection 2.2, we first note that system (56) can be write as an infinite- 
dimensional Hamiltonian system, namely, 

C ^ = J£[(U{t)) 1 

where U = (u\, Vi, 112, V2) = (Re(u),v,lm(u),vt), J is the skew-symmetric matrix 
defined in (7) and £\ is the energy functional 

(61) £ X {U) = \l [u? >x + u\ x + v 2 + v\ x + m 2 v\ - 2v 2 (u\ + u 2 )} dx. 
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We observe that functional T given in (33) is also a conserved quantity of system 
(56). Hence, the linearized operator is this case is given by 



(62) 
where 

(63) 

and 
(64) 



C dn := £('(0, c/>, 0, 0) + cT"{^ 0, 0, 0) = 




dn 



dx 



2 + 2c - 2(j> 2 J 



C 



X.dr, 



dx 2 



2c - 2cf) 2 



V 







1 



As in Section 2, we see that operator Cu,dn also can be diagonalized by a simi- 
larity transformation. Indeed, let 



B-ji = 



Then the operator BnC>n,dnBii =: Con is a diagonal operator given by 

C-l.dn 




(65) 

where 
(66) 
and 
(67) 

Now we can prove: 

Theorem 3.1. Let 

Then, 



-Diz 



dn 



£-3,dn 





£_ 

dx 2 
dx 2 




2c- 



2c + 2cj) 2 



4> = 4> c be the dnoidal wave solution given by Proposition 1. 



(i) operator Cn.dn in (63) defined in L 2 er ([0, L]) x L 2 er ([0, L]) whose domain 
is H 2 er ([0, L}) x H 2 er .([0, L}) has exactly one negative eigenvalue which is 
simple; zero is a simple eigenvalue. Moreover, the remainder of the spectrum 
is constituted by a discrete set of eigenvalues. 

(ii) Operator Cx.dn in (64) defined in L 2 er ([0, L]) x L 2 er ([0, L]) whose domain 
is H 2 er ([0, L]) x L 2 er ([0, L}) has only non-negative eigenvalues being zero 
the first one which is simple. Moreover, the remainder of the spectrum is 
constituted by a discrete set of eigenvalues. 
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Proof. The procedure here follows from the same arguments in Theorem 2.2 and 
therefore we will give only the main steps. 

To prove (i), we observe that operator C±,dn m (66), defined in L 2 er ([0, L]) with 
domain H 2 er ([0, L]) has exactly one negative eigenvalue and zero is a simple eigen- 
value with eigenfunction 4>' . Moreover, operator in (67) (defined in L 2 er ([0, L]) 
with domain H 2 er ([0, L])) is such that (j{Cz,d n ) > 2c. Hence from (65) and argu- 
ments similar as the ones in Theorem 2.2 we prove part (i). 

To prove part (ii), we just note that zero is the first eigenvalue of operator 
£>2,dn = —jtx 1 + 2c — 2(f) 2 with eigenfunction 0. So the proof is completed. □ 

Remark 7. To show the spectral properties of operator C\ dn used in the proof of 
Theorem 3.1 one needs to see that the periodic eigenvalue problem associated to 
£i,dm posed on the interval [0,-L], is equivalent to the periodic eigenvalue problem 
associated to the Lame operator 

d 2 

(68) C L arne = ~~^2 + 6k 2 SU 2 (x] k), 

posed on the interval [0, 2K] (sec [1], [7]). 

Next lemma is in the same spirit of Lemma 2.4. 

Lemma 3.2. Let 4> = 4> c be the cnoidal wave solution given by Proposition 1. Then, 
linear operator Ci,dn in (66) defined in L 2 er ([0,2L}) with domain H 2 er ([0,2L}) has 
its first four eigenvalues simple, being the eigenvalue zero the fourth one with eigen- 
function <fi' . Moreover, if £i and £2 denote the eigenf unctions associated to the 
second and third eigenvalues then £j _L <f>, i = 1, 2. 

Proof. The proof follows combining the periodic and semi-periodic eigenvalues prob- 
lems associated to operator Ci^in with the equivalent problem associated to the 
Lame operator in (68) (see e.g., [7]). □ 

3.2. Stability results. The procedure here follows the same steps as in Subsection 

2.3. Our stability theorem reads as follows: 

Theorem 3.3. Let <f> c be the dnoidal wave solution given by Proposition 1. Then 
the periodic wave solution (e tct (j) c , 4> c ) is orbitally stable in X by the periodic flow of 
system (56) in the sense of Definition 2.5. 

Proof. We apply the abstract Stability Theorem in [18] again. It follows from The- 
orem 3.1 that operator Cdn has a unique negative eigenvalue, its kernel is two- 
dimensional and the remainder of the spectrum is bounded away from zero. More- 
over, by our construction 

(69) £ 1 (0 c ,0 c ,O,O)+c^'(0 c ,0 c ,O,O) = 0. 
Hence, it remains only to show that d"(c) > where 

d(c) = £(<j) c , <j} c , 0, 0) + cT{(j) Cl <t> c , 0, 0). 



From (69) we have d'{c) = T((f) c , cf) c , 0, 0). Therefore, 
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Since k £ (0,1) i— ► K(k)E(k) is a strictly increasing function and dk/dc > (see 
Proposition 1) we see from (70) that d"(c) > 0. This completes the proof of the 
theorem. □ 

Remark 8. As mentioned in Remark 4, by similar arguments presented in this 
section, one can obtain the stability of the solitary standing wave solution of the 
form (e lct (f> c (x) , <j> c (x)), x <G R, c > 0, for equation (1) with f(s,t) = st, where 4> c is 
given by (60). 

3.3. Instability results. The idea here is to prove a similar result as the one in 
Subsection 2.4, in which we prove an orbital instability result taking the advantage 
that the linearized system has the zero solution as an unstable solution. 
We first observe that linearizing system (56) around the orbit, 

r = {P ct (0 c ,0 c ,O,O); teR}, 

where P s is defined in (47), we face the equation 

(71) = JC dn W + 0(\\W\\ 2 ), 

dt 

where W{t) = P^_ ct ^U{t) — {(j) c , <f) c , 0, 0), J and Cdn are defined in (7) and (62), 
respectively. 

Thus we can prove: 

Theorem 3.4. Let (f> c be the dnoidal wave given by Proposition 1. Then the orbit 

r = {P cs (0 c ,0 c ,O,O), set) 

is orbitally unstable in Y in the sense of Definition 2. 7. 

Proof. The proof follows the same analytic-functional approach introduced in Theo- 
rem 2.8 (with obvious modifications), taking into account Theorem 3.1 and Lemma 
3.2 instead of Theorem 2.2 and Lemma 2.4. So, we will omit the details. □ 
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